,  *D-A133  576 


OPTIMAL  RECONSTRUCTIONS  AND  N-WIDTHS(U)  TECHNION  - 
ISRAEL  INST  OF  >ECH  HAIFA  DEPT  OF  MATHEMATICS 
A  A  NELKMAN  ET  AL.  JUN  85  DAJA57-80-C-9254 


i/1 


UNCLASSIFIED 


F/G  12/i 


NL 


apA  1 33  57 (o 


Optical  Reconstructions  and  n-Widths 
Final  Technical  Report 


A.  A.  Melkman  and  A.  Pinkus 


June,  1983 


United  States  Army 

EUROPEAN  RESEARCH  OFFICE  OF  THE  U.  S.  Army  DT1C 

London  England  AELECTE 

.  £  OCT  121983 

CONTRACT  NUMBER  DAJA37-8^C-0234 


Technion  Research  and  Development  Foundation, 

Haifa,  Israel 


*  **§-• 

'^]y'^rowd  for  Public  Release;  distribution  unlimited 


,v  i 

■ft,.- ** 

■ES-.-iv  r  ■ 

:^:li 

;  ''4 'Jaw 

*  >  1 

1S, 


wrrr  rrrrr^r 

UNCLASSIFIED 


».r*  i;  ^ 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  (Wh*n  Data  Bnfnd) 


|  REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

_ 

^^RECIPIENT'S  CATALOG  NUMBER 

y 

4.  TITLE  (mtd  Subtitle) 

Optimal  Reconstructions  and  n-Widths 

5.  TYPE  OF  REPORT  4  PERIOO  COVERED 

Final  Report 

June  1983 

6.  PERFORMING  ORG.  REPORT  NUMBER 

7.  AUTHORO) 

A.  A.  Melkman  and  A.  Pinkus 

8.  CONTRACT  OR  GRANT  NUMBERf.J 

DAJA37-8-C-0234 

9.  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

Technical  -  Israel  Institute  of  Technology 

Department  of  Mathematics 

Haifa,  Israel 

10.  PROGRAM  ELEMENT.  PROJECT,  TASK 
AREA  A  WORK  UNIT  NUMBERS 

1T161102BH57-05 

11.  CONTROLLING  OFFICE  NAME  ANO  ADDRESS 

USARDSG-UK 

Box  65  FPO  NY  09510 

12.  REPORT  DATE 

June  1983 

13.  NUMBER  OF  PAGES 

Nine  (9) 

14.  MONITORING  AGENCY  NAME  a  ADDRESS^//  different  from  Controlling  Olfleo) 

15.  SECURITY  CLASS,  (of  thim  report) 

UNCLASSIFIED 

15..“  DECLASSI  FI  CATION/ DOWN  GRADING 
SCHEDULE 

16.  DISTRIBUTION  STATEMENT  fo/  thle  Report) 

Approved  for  Public  Release;  Distribution  Unlimited  J 

jl 

17.  DISTRIBUTION  STATEMENT  (of  the  ebatrmct  entered  In  Block  20,  It  different  from  Report) 

16.  SUPPLEMENTARY  NOTES 

It.  KEY  WORDS  (Continue  on  remit  mi  dm  II  neceeeery  mnd  Identify  by  block  number) 

n-widths,  optimal  reconstruction,  Sobolev  space, 
time-  and  band-limited  signals. 

1  -  _ 

JL  ABSTRACT  CQmHkmm  mm  reeeree  MW  9t  tmeeeoeey  emd  identify  by  block  mmber) 

This  research  has  been  concerned  with  the  interrelated  subjects  of 
n-widths  and  optimal  reconstruction.  An  attempt  has  been  made  to 
establish  a  mathematical  framework  within  which  a  general  theory 
may  be  developed.  In  addition,  two  important  problems  have  been 
solved.  The  first  of  these  deals  with  n-widths  of  Sobolev  spaces, 
while  the  second  is  concerned  with  optimal  reconstruction  and 
n-widths  of  time-  and  band-limited  signals.^— 

_ _ _ _ ts _ 

■RV-anu i.v’jk'j vtt'  - 


.  •  v- -  *  •  •  •  ■  •  ■ 


AD 


Optimal  Reconstructions  and  n-Widths 


Final  Technical  Report 


by 

A.  A.  Melkman  and  A.  Pinkus 


June,  1983 


United  States  Army 

EUROPEAN  RESEARCH  OFFICE  OF  THE  U.  S.  Army 
London  England 

CONTRACT  NUMBER  DAJA37-8-C-0234 


Technion  Research  and  Development  Foundation, 

Haifa,  Israel 

Approved  for  Public  Release;  distribution  unlimited 


[  Accession  Fop 

MTIS  GRAftI 

X 

DTIC  TAB 

□ 

Unannounced 

□ 

Justification — 

By - - - 

Distribution/ 


Availability  Codas^ 
lAvail  and/or 
Special 


1 


Abstract 

This  research  has  been  concerned  with  the  interrelated 
subjects  of  n-widths  and  optimal  reconstruction.  An  attempt  has 
been  made  to  establish  a  mathematical  framework  within  which  a 
general  theory  may  be  developed.  In  addition,  two  important 
problems  have  been  solved.  The  first  of  these  deals  with  n-widths 
of  Sobolev  spaces,  while  the  second  is  concerned  with  optimal 
reconstruction  and  n-widths  of  time-  and  band-limited  signals. 


Keywords:  n-widths,  optimal  reconstruction,  Sobolev  space,  time- 
and  band- limited  signals. 
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§1 .  Introduction 

In  Sections  2  and  3  we  present  the  mathematical  models  of 
both  n-widths  and  optimal  reconstructions.  Sections  4  and  5  are  a 
discussion  of  work  done  by  the  principal  investigator  during  the 
past  two  years  in  the  area,  and  in  particular  with  respect  to 
n-widths  of  Sobolev  spaces.  In  Section  6  we  present  some  of  the 
work  recently  done  by  the  associate  investigator  on  time-  and 
band-limited  signals. 


W*  1*. 
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§2 .  n-Widths  :  Background 

Let  X  be  a  normed  linear  space  and  A  a  subset  of  X.  For  a 
given  continuous  linear  rank  n  map  Pn  of  X  into  itself,  the 
quantity 

sup{  ||  x-Pnx  ||  :  x  €  A} 

measures  the  degree  to  which  A  is  approximated  by  the  linear  wap 
P  .  The  linear  n-width  of  A  in  X  is  defined  by 

<5n(A;X)  =  inf  sup  ||  x  -  P  x|| 

n  P  x  €  A  n 

n 

where  P  runs  over  all  continuous  linear  rank  n  maps.  The  linear 
n 

n-width  measures  the  extent  to  which  A  is  approximable  by  such 
maps.  If  in  place  of  linear  approximants  P  ,  we  consider  best 

approximations  from  the  range  of  Pn  (in  general  a  non-linear  map) 

then  we  obtain,  analogously,  the  Kolmogorov  n-width  of  A  in  x  as 
defined  by 

d  (A;X)  =  inf  sup  inf  ||  x-y||, 

n  X  x  €  A  y  €  X 

n  '  n 

where  the  left-most  infimum  runs  over  all  n-dimensional  subspaces 
X  of  X.  The  Kolmogorov  n-width  measures  the  degree  to  which 
n-dimensional  subspaces  can  approximate  A.  It  was,  chronological¬ 
ly,  the  first  n-width  concept  and  was  introduced  by  Kolmogorov 
[K]  in  1936. 

Two  other  n-width  concepts  have  a  less  obvious  motivation 
but  deserve  mention.  The  first  of  these  is  the  Gel'fand  n-width 
of  A  in  X.  It  is  given  by 


d  (A;X)  =  inf 
,  n 


I  x  H  , 


x  €  A  n  L 


where  the  Ln  range  over  all  closed  subspaces  of  X  of  codimension 
at  most  n.  One  reason  for  generally  introducing  the  Gel'fand 
n-width  is  due  to  a  duality  relationship  which  exists  between  it 
and  the  Kolmogorov  n-width-.  More  importantly,  perhaps,  is  the 
fact  that  the  Gel'fand  n-width  provides  a  lower  bound  on  the 
problem  of  optimal  reconstruction  of  elements  of  A  based  on  n 
information  data. 

The  Bernstein  n-width  of  A  in  X  is  given  by 

b  (A;X)  =  sup  sup{A  :  AS (X  , )  c  A} 
n  y  n  x 

V-i 
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where  3(Xn+j)  is  the  unit  ball  in  Xn+j,  and  Xn+^  ranges  over  all 

subspaces  of  X  of  dimension  at  least  n+1.  The  Bernstein  n-width 

is  important  in  that  6n(A;X)  £  dn(A;X),  dn(A;X)  £  bn(A;X).  When 

strict  inequalities  occur  then  the  determination  of  these 
quantities  is  ofen  an  insurmountable  problem.  In  addition,  the 
Bernstein  n-width  is  also  connected  with  the  problem  of  optimal 
constants  in  Bernstein-Markov  type  inequalities. 

One  is  generally  interested  in  one  of  two  problems  for 
specific  A  and  X.  Either  exactly  determine  the  n-widths  and 
identify  optimal  subspaces  and  operators,  or  determine  the  asymp¬ 
totic  values  of  the  n-widths  as  nt°°. 

The  topics  of  n-widths  in  approximation  theory  (n-widths  have 
also  been  successfully  applied  in  other  areas  of  mathematics)  has 
been  a  vital  subject  for  the  last  twenty  or  so  years.  One  can 
grossly  divide  the  main  work  on  this  subject  into  six  areas.  These 
are 

1)  basic  properties 

2)  n-widths  in  Hilbert  spaces 

3)  exact  n-widths  for  integral  operators  (especially  for 
Sobolev  spaces) 

4)  n-widths  and  matrices 

5)  asymptotic  estimates  for  n-widths  of  Sobolev  spaces 

6)  n-widths  of  spaces  of  analytic  functions. 


Optimal  Reconstruction:  Background 


Optimal  reconstruction,  often  called  optimal  recovery,  is 
based,  more  or  less,  on  the  following  model.  Assume  that  X,Y,Z 
are  normed  linear  spaces,  and  U  :  X  -*■  Z  and  J  :  X  Y  are  linear 
operators.  The  problem  is  to  estimate  Ux  given  the  fact  that 
x  €  A  c  X,  some  a  priori  information  Jx  or  perhaps  the  additional 
data  y  €  Y  which  may  be  somewhat  inaccurate  as  expressed  by 
||  Jx-y||  £  e.  Given  a  map  S  :  Y  -*■  Z  one  may  take  Sy  as  an  estimate 
of  Ux.  In  the  worst  case  analysis,  such  a  reconstruction  S  is 
normed  by 

E(S)  =  sup{||Ux-Sy||  :  x  G  A  ,  ||  Jx-y||  £  e). 

The  inherent  error  in  the  problem  is  E  *  inf  E(S)  and  a  recovery 
process  S*  which  achieves  this  infimum  a  called  an  optimal 
reconstruction. 


When  optimizing  the  information  operator  J,  one  is  naturally 
led  to  an  n-width  problem.  In  particular  to  problems  connected 
with  Gel'fand  n-widths  (see  e.g.  Traub,  Wozniakowski  [TW]). 
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§4-  General  work 


One  of  the  primary  objectives  of  this  research  was  an  attempt 
to  establish  a  theoretical  framework  for  the  subject  of  n-widths 
in  approximation  theory.  As  such  much  effort  originally  went  into 
general  surveys  of  the  subject.  After  completing  two  such  surveys, 
the  principal  investigator  was  approached  by  for inger-Verlag 
Publishers.  These  surveys  were  considerably  expanded  and  a  mono¬ 
graph  on  n-widths  in  approximation  theory  should  appear  soon.  A 
good  deal  of  the  monograph  is  original  work,  not  only  in  its  pre¬ 
sentation,  but  also  in  many  of  the  results.  In  addition,  the 
principal  investigator  was  invited  to  contribute  a  survey  paper  on 
n-widths  at  the  converence  in  approximation  theory  held  in  College 
Station,  Texas  in  January,  1983.  The  paper  will  appear  in  a  book 
to  be  published  by  Academic  Press. 


§5 .  n-Widths  in  Sobolev  Spaces 

Let  W^p^[0,l]  denote  the  Sobolev  space  on  [0,1]  defined  by 
W^lO.l]  =  { f :  £6r"1)abs.cont.  ,  f €  Lp> 

and  set  =  {f:  f  €  W^[0,1]  ,  ||  f ^  ||  p  <  1},  where  ||  *||p 

is  the  usual  Lp-norm. 


One  of  the  major  open  problems  in  n-widths  has  been  the 

determination  of  the  n-widths  of  B^p^  in  ,  p,q  €  [  1  ,«*»]  .  This 

problem  had  been  solved  for  p  *  q  =  2  by  Kolmogorov  [K]  and 
Melkman,  Micchelli  [MM],  for  p  =  q  =  “  by  Tichomirov  [T  ] ,  and  for 
p  =  ®»,  all  q  and  q  =  1,  all  p  by  Micchelli,  Pinkus  [MP] .  On  the 
basis  of  these  results,  various  conjecture  had  been  made  concerning  the 
n-widths  of  Bl&>  in  L^^for  p>q.  The  principal  investigator  has  proved  all  these  con¬ 
jectures  for  p  =  q  €  [1,«*>] . .  lit  particular  - 
•  -  •* 

Theorem.  Let  B> '  be  as  defined  above.  Then 


(r) 

P 


;Lp)  - 


* 


Furthermore ,  there  exist  for  each  p  and  r,  two  sets  of  points 
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1) 

2) 

3) 


Xn  =  span{l ,x, . . .  ,x  >  (x-^^)  +  >«..»  (x-£^_^)  +  } 

is  optimal  for  d  (B  ^  ;LP)  (i.e.,  splines  of  degree  r-1  with 
n-r  fixed  knots) . 

Ln  =  {f  :  f  €  >  f (ni)  *  0,  i  =  1,...,  n}  is  optimal  for 


dn(B(r);lP). 

p  frl  n 

P_  defined  by  interpolating  f  €  B  at  the  {n.-}.-.,  from 

II  - c *  r  \ r  ~  p  -  1  1-1  - 

Xn  is  optimal  for  6n (B  ; Lp) . 


Time-  and  Band-Limited  Signals 


One  aspect  of  the  present  investigations  concerns  the 
connection  between  "real  world"  phenomena  and  the  mathematical 
models.  This  question  was  discussed  by  Slepian  [S]  in  the  1974 
Shannon  Lecture.  He  suggested  that  there  are  certain  constructs 
in  a  model,  principal  quantities,  to  which  we  attach  physical 
significance.  Others,  secondary  quantities,  have  no  meaningful 
physical  counterpart.  In  a  "useful"  model  the  principal  quanti¬ 
ties  should  be  insensitive  to  small  changes  in  the  secondary 
quantities.  We  consider  the  example  of  time-  and  band-limited 
signals . 


In  modeling  this  class  one  is  immediately  confronted  with  two 
design  decisions. 

a.  what  should  be  the  mathematical  class  of  functions? 

b.  which  norm  should  be  imposed? 


The  problem  with  (a)  is  that  the  mathematical  equivalent  of 
band- limitedness,  .  i.e.,  Fourier  transform  supported  on  a  finite 
interval,  implies  immediately  that  the  function  is  entire.  Such 
a  function  cannot  be  time-limited.  The  way  out  of  this  paradox 
proposed  by  Slepian  lies  in  the  recognition  that  actual  signals 
are  de  facto  time-  and  band- limited  because  no  measuring  apparatus 
distinguishes  them  from  zero  outside  a  certain  band-width  and  time- 
duration.  Thus,  in  the  model  any  mathematically  reasonable  class 
of  functions  is  acceptable  if  it  preserves  the  principal  quanti¬ 
ties,  band-width  and  time-duration.  In  particular,  one  might 
choose  to  deal  with  strictly  band-limited  functions  which  are 
"immeasurably  small"  except  during  a  specified  time-duration.  Such 
a  function  will  model  an  actual  signal  only  to  within  measurement 
accuracy. 

As  for  (b) ,  in  the  original  series  of  papers  by  Landau, 

Pollack  [LP]  Slepian  [S] ,  and  Melkman  [M] ,  the  L2-norm  was 
chosen.  But  ’  i  not  a  foregone  conclusion,  and  in  fact  a 


cogent  argument  can  be  made  for  choosing  the  sup  (L°°) -norm  as  was 
done  by  the  associate  investigator  in  the  present  work. 

It  is  important  that  design  decisions  be  buttressed  by  a 
verification  that  their  major  conclusions  are  independent  of  the 
particular  decision,  i.e.,  measurement  accuracy  and  norm  chosen. 
Two  results  obtained  during  the  research  program  provide  such 
verification . 

Result  1.  The  number  of  independent  signals  of  band-width  a  and 
time-duration  2T  (the  dimensionality  of  the  set)  is 
irrespective  of  the  measurement  accuracy  and  norm  imposed  (L2  or 

Result  2.  An  optimal  set  of  functions  for  the  purpose  of  inter- 
polation  /  approximation  consists  of  sine  functions  in  both  the 
L2-  and  L°°-norm. 

It  is  conjectured  that  these  results  continue  to  hold  in  any 
I/3 -norm. 

In  a  paper  to  appear,  these  results  are  presented  in  a  mathematical 
framework  of  optimal  reconstruction  and  n-widths . 
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